README: Vestiges of Transit
Leah Brooks & Byron Lutz
12/19/2018

original location of this file:
/groups/brooksgrp/zoning/streetcar_stops/stata_programs/restat_final_readme/readme.txt

----

Software versions: SAS 9.4, Stata 13.1

----

Our naming convention is that the latest dated or largest numbered file is the most recent. 

---

The parcel data we use in this project are not public data.  We include programs that prepare 
these data, but not the underlying data themselves.  We also omit datasets that consist of parcel 
data combined with other data souces. 

We do include original datasets we created for ths project without the combination of parcel data.  
See section F.

The appendix to the paper provides complete source information for all datasets.

----

A. Final tables

A.1. programs that create final tables and figures

Programs that produces final figures and tables is 
  restat_final_all_programs/final_tables_figures/tables_figures_v35.do
  original location: /groups/brooksgrp/zoning/streetcar_stops/stata_programs/restat_paper_tables/tables_figures_v34.do

Also for appendix figures and tables see
  restat_final_all_programs/final_tables_figures/ridershipfigsv09.do
  original location: /home/lfbrooks/zoning/streetcars/stataprg/ridership_pictures/ridershipfigsv09.do

A.2. programs that create datasets called by programs in A.1.

  ** figure data **
  * data
  not posted: /groups/brooksgrp/zoning/streetcar_stops/parcel_level_datasets/historical_population_densities/1940_consistent_tracts/binned_data/cons_ts_1940to2010_20170927.sas7bdat
  * created by 
  census_tract_data/to1940tractsv34.sas 
  original location: /home/lfbrooks/zoning/streetcars/sasprg/consistent_1940_tracts/to1940tractsv34.sas 

  ** parcel level data, mostly for tables **
  * data
  not posted: /groups/brooksgrp/zoning/parcel_datasets/streetcars/revised_merged_dataset/scar_revmgd_20170808_2011_xsec.dta
  * created by 
  parcel_data_programs/data_stata_prep_v05.do 
  original location: /groups/brooksgrp/zoning/streetcar_stops/stata_programs/xsection_setup/data_stata_prep_v05.do 

  ** city population data ** 
  * data (see section C below)
  not posted: /groups/brooksgrp/zoning/streetcar_stops/los_angeles_population_over_long_time/assembled_data/2012-09-14_la_cnty_and_c3ities_pop_1850_2000.dta
  * no program - just loaded straight from xls

  ** ridership data ** 
  * data (see section B below)
  /groups/brooksgrp/zoning/streetcar_stops/stata_output/restat_paper_tables/data/20170803_ridership_data.dta;
  * created in
  final_tables_figures/ridershipfigsv09.do
  end of step b
  original location: /home/lfbrooks/zoning/streetcars/stataprg/ridership_pictures/ridershipfigsv09.do

  ** density for pics, including 1930 
  * data
  not posted: /groups/brooksgrp/zoning/streetcar_stops/parcel_level_datasets/historical_population_densities/aggregate_densities_for_plotting/density_1930to2000_20121030
  * created in 
  parcel_data_programs/adddensityv30.sas
  original location: /home/lfbrooks/zoning/streetcars/sasprg/add_historical_density/adddensityv30.sas


B. Ridership data

  * data 
  /groups/brooksgrp/zoning/streetcar_stops/stata_output/restat_paper_tables/data/20170803_ridership_data.dta;
  * created in
  final_tables_figures/ridershipfigsv09.do
  original location: /home/lfbrooks/zoning/streetcars/stataprg/ridership_pictures/ridershipfigsv09.do
  * see end of step b
  * underlying data in 
  data_final_restat/2013-03-01_Streetcar_Ridership_Figures_nofirst.txt
  original location: /groups/brooksgrp/zoning/streetcar_stops/streetcar_ridership_data/2013-03-01_Streetcar_Ridership_Figures_nofirst.txt


C. City Population data

  ** data **
  data_final_restat/2012-09-14_la_cnty_and_c3ities_pop_1850_2000.dta
  original location: /groups/brooksgrp/zoning/streetcar_stops/los_angeles_population_over_long_time/assembled_data/2012-09-14_la_cnty_and_c3ities_pop_1850_2000.dta
  * no program
  stat transfered from excel


D. Binned data for figures

D.1. density data

  ** density for pics, including 1930
  * data
  * not copied, as includes parcel data *
  original location: /groups/brooksgrp/zoning/streetcar_stops/parcel_level_datasets/historical_population_densities/aggregate_densities_for_plotting/density_1930to2000_20121030;
  * created in 
  parcel_data_programs/adddensityv30.sas
  original location: /home/lfbrooks/zoning/streetcars/sasprg/add_historical_density/adddensityv30.sas

D.2 underlying data called by adddensityv30.sas

  * intersection of 2011 parcel map (cannot deposit due to data restrictions)
  * with 1990 block group / tract maps
  * these can be downloaded from NHGIS.org
  * used ArcGIS to do these intersctions via GUI
  * most recent version as of 2012

  * also calls census block group and tract data, 1930 to 2010 (ACS)
  * loading programs are
  * 1930 tract data 
  census_tract_data/in1930v02.sas
  original location: /home/lfbrooks/frb_home_dirs/jessicah/zoning/sasprg/census_block_group_data/y1930/in1930v02.sas
  * 1940 tract data
  census_tract_data/in1940v03.sas
  original location: /home/lfbrooks/frb_home_dirs/jessicah/zoning/sasprg/census_block_group_data/y1940/in1940v03.sas
  * 1950 tract data
  census_tract_data/in1950v02.sas
  original location: /home/lfbrooks/frb_home_dirs/jessicah/zoning/sasprg/census_block_group_data/y1950/in1950v02.sas
  * 1960 tract data
  census_tract_data/in1960v02.sas
  original location: /home/lfbrooks/frb_home_dirs/jessicah/zoning/sasprg/census_block_group_data/y1960/in1960v02.sas
  * 1970 tract data
  ** now copied to census_tract_data
  census_tract_data/input1970v31.sas
  original location: /home/lfbrooks/frb_home_dirs/jessicah/zoning/sasprg/census_block_group_data/y1970/input1970v31.sas
  * 1980 tract data
  census_tract_data/input1980v17.sas
  original location: /home/lfbrooks/frb_home_dirs/jessicah/zoning/sasprg/census_block_group_data/y1980/input1980v17.sas
  * 1990 tract data
  census_tract_data/in1990v02.sas
  original location: /home/lfbrooks/frb_home_dirs/jessicah/zoning/sasprg/census_block_group_data/y1990/in1990v02.sas
  * 1990 block group data 
  census_tract_data/bgs1990standalonev01.sas
  original location: /home/lfbrooks/zoning/sasprg/census_block_group_data/y1990/bgs1990standalonev01.sas
  * 2000 tracts *
  census_tract_data/in2000v01.sas
  original location: /home/lfbrooks/frb_home_dirs/jessicah/zoning/sasprg/census_block_group_data/y2000/in2000v01.sas
  * 2000 block group w/o place
  census_tract_data/bgsnoplace2000v3.sas
  original location: /home/lfbrooks/zoning/sasprg/census_block_group_data/y2000/bgsnoplace2000v3.sas

  ** this program creates
  * (1) binned data
  /groups/brooksgrp/zoning/streetcar_stops/parcel_level_datasets/historical_population_densities/aggregate_densities_for_plotting/density_1930to2000_[date]
  * (2) non-binned data with historical info 
  /groups/brooksgrp/data/zoning/streetcar_stops/parcel_level_datasets/historical_population_densities/parc_w_dens_1930to2000_[date]
  ** both of these include parcel data so we cannot release them publicly

E. main parcel-lvl dataset and creation

E.1. main parcel dataset

  ** main dataset: parcel level data, mostly for tables **
  * data
  * not posted, as it contains parcel data
  /groups/brooksgrp/zoning/parcel_datasets/streetcars/revised_merged_dataset/scar_revmgd_20170808_2011_xsec.dta
  * created by 
  parcel_data_programs/data_stata_prep_v05.do 
  original location: /groups/brooksgrp/zoning/streetcar_stops/stata_programs/xsection_setup/data_stata_prep_v05.do 


E.2. programs that lead into the dataset in E.1, in order

  All names below are original paths. All these files are in 
  parcel_data_programs/

  ** program above uses data created in 
  /home/lfbrooks/zoning/streetcars/sasprg/revise_merged_dataset/scar_setupv21.sas
     ** this program uses data created in 
     /home/lfbrooks/zoning/streetcars/sasprg/trans_matrix_z_1922to2011/clean1922workv08.sas
     /home/lfbrooks/zoning/streetcars/sasprg/trans_matrix_z_1922to2011/transmatzv09.sas
  /home/lfbrooks/zoning/sasprg/sales_data_assembly/merge_sales_and_panel_w2011_v48.sas
  /home/lfbrooks/zoning/sasprg/sales_data_assembly/salesinw2011v20.sas
  /home/lfbrooks/zoning/land_assembly/sasprg/combine_block_group_data/bgs90and00v10.sas
  /home/lfbrooks/los_angeles_property_data/sasprg/parcels_to_city_ids_via_intersect/parcwithcityv05.sas
  /home/lfbrooks/zoning/sasprg/parcel_distances_to_amenities/calc_distsv16.sas
  /home/lfbrooks/zoning/sasprg/parcel_distances_to_amenities/scar_distsv02.sas
    ** this program uses data created in 
    /home/lfbrooks/zoning/sasprg/streetcar_data_input_to_sas/carsinv04.sas
  /home/lfbrooks/zoning/land_assembly/sasprg/identify_tear_downs/idteardowns_w2011_v05.sas
  /home/lfbrooks/zoning/land_assembly/sasprg/identify_tear_downs/asmteardown_w2011_v06.sas
  /home/lfbrooks/los_angeles_property_data/sasprg/building_footprint_to_parcels/footprints_to_parcelsv16.sas
  /home/lfbrooks/zoning/sasprg/zoning_xsection_data/secondnewattsv38.sas 
    ** this program uses data created in 
    /groups/brooksgrp/zoning/los_angeles_classifications/code_classifications/shared_sas_programs/input_all_city_by_city_files/citybycityfilesin.sas

  ** for the property panel dataset, see full documentation at
  https://www.aeaweb.org/articles?id=10.1257/pol.20130399


F. data created for this project, not otherwise publicly available

F.1. 1922 zoning data

  modern parcel id (c. 2011) + 1922 zone code
  data_final_restat/z1922_togeth_20140307.dbf, .sas7bdat  
  original location: /groups/brooksgrp/maps/los_angeles/zoning/1922_city_of_la_zoning_atlas/la_city_parcels_w_1922_zoning/combined/z1922_togeth_20140307.*

F.2. modern zoning attribute data 

  data_final_restat/modern_zoning_data/[city abbreviation]_[date file created]_modified_[most recent date modified].xls/.sas7bdat
  original location: /groups/brooksgrp/zoning/los_angeles_classifications/code_classifications/residential_code_classifications/code_match_information
  loaded in program /home/lfbrooks/zoning/sasprg/zoning_xsection_data/secondnewattsv38.sas (see E above)

F.3. streetcar map 

  F.3.a Pacific Electric 

  data_final_restat/maps/
  1915-LA-PE_2011_06_26.*
  1928-PElines_2011-06-26.*
  1928-PEpoints_2011-06-26.
  original location: /groups/brooksgrp/zoning/streetcar_stops/streetcar_shapefile_maps
  called in /home/lfbrooks/zoning/sasprg/streetcar_data_input_to_sas/carsinv04.sas

  F.3.b. Los Angeles Railway (no stops)

  data_final_restat/maps/193x-LArail_2011-6-26a.*
  original location: /groups/brooksgrp/zoning/streetcar_stops/streetcar_shapefile_maps
  called in /home/lfbrooks/zoning/sasprg/streetcar_data_input_to_sas/carsinv04.sas 

F.4. 1925 & 1934 roads

  F.4.a. 1934 Roads

  data_final_restat/maps/major_roads_1934_20121203.*
  original location: /groups/brooksgrp/zoning/streetcar_stops/major_roads_and_nonstr_transit_maps/1934_major_roads_shapefile/major_roads_1934_20121203.*
  called in /home/lfbrooks/zoning/sasprg/parcel_distances_to_amenities/calc_distsv16.sas

  F.4.b. 1934 Intersections 

  data_final_restat/maps/mjrds_1934_ints_20140403.*
  original location: /groups/brooksgrp/zoning/streetcar_stops/major_roads_and_nonstr_transit_maps/1934_major_roads_shapefile/major_roads_1934_intersections/mjrds_1934_ints_20140403.*
  called in /home/lfbrooks/zoning/sasprg/parcel_distances_to_amenities/calc_distsv16.sas
 
  F.4.c. 1925 roads

  data_final_restat/maps/major_roads_1934_20121203_1925rds_only.*
  original location: /groups/brooksgrp/zoning/streetcar_stops/major_roads_and_nonstr_transit_maps/1934_major_roads_shapefile/1925_roads_only/major_roads_1934_20121203_1925rds_only.*
  called in /home/lfbrooks/zoning/sasprg/parcel_distances_to_amenities/calc_distsv16.sas


G. Misc other programs

  G.1. macro to create today's date

  restat_final_all_programs/macros/dateo.sas
  original location: /home/lfbrooks/sas_basics/dateo.sas
  called in most sas programs above
